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Abstract 

The deterministic capacity of a relay network is the capacity of a network when relays are restricted to transmitting 
reliable information, that is, (asymptotically) deterministic function of the source message. In this paper it is shown 
that the deterministic capacity of a number of MIMO relay networks can be found in the low power regime where 
SNR — > 0. This is accomplished through deriving single letter upper bounds and finding the limit of these as 
SNR — > 0. The advantage of this technique is that it overcomes the difficulty of finding optimum distributions for 
mutual information. 

Index Terms 
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I. Introduction 

Recently there has been a large renewed interest in analyzing capacity of networks, in particular wireless networks. 
It has been found that the capacity of wireless networks can be increased by using the fact that the wireless signal 
propagates widely (the multicast advantage) and letting nodes cooperate (cooperative diversity) [1]. Coding methods 
for networks can generally be divided into two classes: those where relays process the received signal and forwards 
it, and those where the relays decode (a function of) the original message, and encodes this into a new signal. In the 
first class (some times denoted estimate-forward) are methods such as amplify-forward and compress-forward [2], 
[3] that have wide set of generalizations [??]. The second class (sometime denoted regenerative coding) has as its 
source the original decode-forward strategy of [4]. For a single antenna single relay channel [4]'s original strategy 
appears to be the only member of this class. However, for multiple antenna relay channels [5], [6] and multi-node 
networks [7], [8] there are many possible generalizations. What characterizes these methods, as opposed to the first 
class, is that relays decodes the original message, or more generally, a function of the original message, reliably 
(which also relates it to [9]), and transmits a message which is a possibly different function of the decoded message 
(e.g., in [8] the parity information). One way to characterize this class is that the transmission is reliable. Relays 
decode their messages with a vanishing error probability, and base their transmission on deterministic function^] 
of the messages. We will therefore denote this type of coding reliable coding, or deterministic coding. In contrast, 
amplify-forward type methods introduces further randomness through the noise at the relays. Informally one could 
say that amplify-forward type methods introduces errors in their transmission streams, while reliable transmission 
eliminates errors. 

A. H0st-Madsen is with the Department of Electrical Engineering, University of Hawaii Manoa, Honolulu, HI 96822 (e-mail: mad- 
sen@spectra.eng.hawaii.edu. This work was supported in part by NSF grant CCF 0729152. This paper was presented in part at IEEE Information 
Theory Workshop, ITW 07, Lake Tahoe and Asilomar Conference on Signals and Systems, 2008. 

'Deterministic in the sense that the functions do no depend on the noise realization in the network. Random encoding can be considered 
deterministic as nodes can share a common random number generator. 
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The aim of this paper is to bound the capacity that can be achieved with reliable transmission. Why reliable 
transmission? A number of practical arguments can be made in favor of reliable transmission: in large networks 
regeneration is needed at some point to avoid errors to accumulate. It is more similar to traditional multi-hop 
networking, making implementation potentially more smooth. It can seamlessly be combined with network coding 
[10]. When the the signal to noise ratio SNR — > the noise in amplify-forward type becomes dominating, making 
the methods inefficient. The motivation for considering reliable transmission is this paper is mainly intellectual, 
though. It is a rather well characterized set of coding methods (think linear versus non-linear), and it is therefore 
of interests to find what rates can be achieved within this class of coding methods. Additionally, there are very 
few networks where the actual capacity can be found; even the simplest Gaussian relay channel has an unknown 
capacity. However, as will be seen, by restricting coding to this smaller class of methods, tight upper and lower 
bounds can be found for some networks under certain conditions. This is of course not the actual network capacity. 
However, it could be considered a restricted capacity, just as the capacity of a channel with modulation restricted 
to for example BPSK could be considered the BPSK capacity. 

The rest of the paper is organized as follows. First we need a precise definition of what is meant by reliable 
transmission; this is provided in Section [II] In Section [Til] some results about the low power regime, SNR — > 0, are 
derived. As the main part, the capacity for reliable transmission of some MIMO relay networks is found in Section 
HVl Finally, generalizations of the results are discussed in section [V] 

II. Definitions and Initial Remarks 

We consider a network with N nodes as in [11, Sec. 14.10]; each nodes may have multiple antennas. We denote 
the transmitted symbol (which might be a vector) at time m at node i by Xi[m], the transmitted symbol from the j-th 
antenna by iy [m], and the string of transmitted symbols in the interval 1 ... k by x^ [k] = [x^ [1] , Xij [2] , . . . , Xij [k]]. 
Similarly for the received signal yi[n] and yij[n] at node i. A (length n) code for the network is defined as in 
[11, Sec. 14.10]: Node 1, the source has a message W intended for node N which it transmits at rate R; we 
consider the message a uniform random variable over {l, 2, . . . , 2 nR }. The encoder at node i is a function (or 
code) a;j[m](yj[l , . .m— 1]), m e {1, . . . , n} that depends only on past received symbols. The transmitted signal 
is a random variable -Xj[m] with the randomness coming from both the random message W and from the noise 
in the received signal yi[m]. The essence of deterministic capacity is to remove this latter randomness, with the 
following precise definition 

Definition 1: A sequence of codes {sjn],« — 1. . . N} is said to be deterministic or reliable if there exists a 
sequence of deterministic functions of the message W,{£j»i](W), i — 1 . . . N}, so that 

Vi € {1,...,JV} lim P{ljn] ^XJn]} = (1) 

n— *OQ 

lim P{W{Y_ N [n]) ^ W} = (2) 

n — >oo 

The deterministic capacity is the supremum of all rates R that is achievable by deterministic codes. 
The definition is related to the computation rate in [9]. In this case, each node needs to compute a function of 
the message. This function is precisely the signal it is going to transmit. The principle is that there is no reason a 
node should decode more than needed for transmission. For example, if it transmits parity information about the 
message, this is all that it also needs to decode. 

Equation (O is the usual capacity condition of asymptotically zero decoding error probability. Equation (Q]) 
similarly states that, asymptotically, what node i transmits depends only on the messages in the network, not the 
noise (realization). It therefore clearly excludes coding schemes such as amplify-forward [1] and compress-forward 
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[4], [2], [3], but includes all decode-forward schemes known to the author: namely, in decode-forward a node 
decodes the message and forwards it. Since the condition is that this decoding happens with asymptotically zero 
error probability, it satisfies ((T). However, the definition of deterministic capacity is much more general than specific 
decode-forward schemes, as is allows much flexibility of ijrt], including schemes such as those in [8]. 

One feature of definition Q] is that it allows usage of traditional methods of information theory. Equation (Q]) 
essentially says that node i should be able to decode the function XJn], One can then for example use Fano's 
inequality to outer bound the rate region. If there exist (decode-forward) coding methods achieving this outer bond, 
this is then the (deterministic) capacity. 

While definition [T] applies to general channel models, We will in the following restrict attention to static, wireless 
channels with additive complex Gaussian noise of power BNq, where Nq is the noise power spectral density, and 
B is the bandwidth. The static, complex, channel gain from node i to node j is cy L , and if node i has more than 
one antenna Cjik', we also define cy = [cyi . . . cyjy]. We consider two case of channel state information (CSI): 

• The synchronous case: all nodes are assumed to have full channel state information, i.e., to know perfectly all 

Cjik ■ 

• The phase fading case[3], [12], [5]: all nodes know all \cjik\, whereas the phase of Cijk is unknown to 
transmitters, but known at receivers. The phase of is assumed to vary ergodic during transmission. This 
can be used to model nodes that don't have synchronized local oscillators. 

As a simple application of the definition we consider the one-relay relay network from [4], with a single relay and 
one antenna at all nodes. The received signals are 

YM = c 21 xm + z 2 M (3) 

YM] = c 3 iX 1 [n] + C32X 2 [n]+^ 3 [n] (4) 
Suppose \c2i \ > \c3\\. Then node 2 can form 

X!M\ = —Y 2 [n] + c 32 X 2 [n] + Z! 2 [n] (5) 

- c 3 iXM}+c 32 X 2 [n} + ^Z 2 [n} + Z^[n] (6) 

C 2 1 

I |2 

where Z 2 [n] is iid Gaussian noise with power 1 — M^U . Now consider the two companion signals 

1M\ = c 31 xM] + c 32 xm} + zm] (7) 

ZM] = — Y 2 [n]+c 32 X 2 [n] + Z! 2 [n] (8) 

C21 

By assumption node 3 can decode W with small probability of error for large n. Since we consider deterministic 
capacity, we know that Y_ 3 [n] = Y 3 [n] with high probability for large n. A genie-aided node knowing Y 3 [n] 
therefore also can decode W with small error probability (formally, the genie-aided node's error probability is 
bounded by pj n) < Pe n) + P{X_M\ + £ 3 N))- Now ' because X 2 [n] is a deterministic function of W, Y 3 [n] and 
Y_ 3 [n] have the same distribution. Thus, a genie-aided node knowing Y_ 3 [n] can also decode W with small error 
probability. Finally, since H 3 M — 11 3 M with high probability, a node knowing Y^jn] can also decode W with 
small error probability. Thus, node 2 can decode W. A similar argument shows that for |c2i| < |c 3 i| it does not 
help the destination to know Y 3 [n]. Therefore, the rate is bounded bj|§ max{/(Xi; 12^2), I(Xi;Y 3 \X 2 )}, as well 
as the MAC bound I{X\, X 2 \ Y 3 ). On the other hand, Cover and El-Gamal's [4] block-Markov coding achieves 

2 The conditioning on X2 enters the same way as the proof of Theorem 15.10.1 in [11] 
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this bound, and this is therefore the deterministic capacity. Essentially, this shows, not surprisingly, that Cover and 
El-Gamal's scheme is optimum among all decode-forward schemes. 

It is difficult to extend the above example to larger networks. A major problem is proving that a Gaussian 
distribution is optimum. This problem can be overcome by working in the low power regime, and the rest of the 
paper will therefore restrict attention to this regime. 

III. The Low Power Regime 

The capacity of the channel depends on the bandwidth as follows [11]: Fix P (in Watts) and let the available 
bandwidth be B (in Hz). The available power per sample is then P/(2B) and the noise variance per sample No/2. 
If we denote by C(B) the capacity (or spectral efficiency, [13]) in nats/s/Hz for a given bandwidth, we can define 
the following limit (if it exists) 

C = lim BC{B) (9) 

B^oo 

which is the limit of the capacity in nats/s for infinite bandwidth. We call the infinite bandwidth limit the low power 
regime; this has been considered in many papers, with the two papers [13], [14] breakthroughs. Signaling in the 
low power regime has a number of advantages: robustness to interference, little interference generation, covertness, 
etc., and is the principle behind UWB. For a point-to-point channel it is also the most energy efficient signaling. 
For multi-terminal channels it is not clear if this is still true, see e.g., [15]. 

The low power regime also has the theoretical advantage that C may be calculated without having explicit 
expressions for C(B) using the techniques in [14] combined with the further results in [16], as we will see in the 
following. 

We will denote rates in the low power regime by sans serif, i.e., if R < C we say that the rate R (in nats/s) is 
achievable. Similarly, if R < C(B), we say that the rate R (in nats/s/Hz) is achievable. 
We need the following generalizations of results in [16]. 

Lemma 1: Suppose that for each value of B a random (iV-vector) random variable X(B) that satisfy var[X(i?)] < 
P is giverE Let Y = c H X(B) + Z, where Z ~ W(0, N B). If c is a constant vector 

lim BI(X(B)-Y) = lim (10 ) 

B—>oo B— >oo iVo 

If Ci — \ci\ e J \ where Oi are iid random variables uniform on [0, 27r] and \ci\ constant then 

lim BI(X(B);Y\e) = lim ^ ^fflgl] (11 ) 
Proof: The proof follows quite closely the proof of Lemma 1 in [16]. For completeness we will provide 
the proof in the asynchronous case. We can assume that X(£>) has zero mean, as the mean will not influence the 
mutual information. Put Y ~ Af 

(o,E l =i \ci\ 2 vw[Xi{B)] + 7V s), and write 
J(X(5);Y|0) = D(P YlMB) \\P^\P x{B) ,P g ) (12) 
-D(P Y \\P^\P e ) (13) 

3 varX(B) = tiE [X(B)X(_B) ff ] 
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The first term is 



Since 



Thus 



D{PY mB )\\P*\P>«B),Pe) 

= J D (P Y |x=xe||P Y ) dP m dP e 



c H X(B) 



i=i 



(14) 



+ (.6, 



J \c H X(B)\ 2 dP MB )dPe = J c H E [X(B)X(B) H ] cdPg (17) 

N 

= ^Ic^var^CB)] (18) 



V^BD (P Y | X (b)||-PyI p x(s),^) 
= Um SkhM^ (19) 
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The second term in ( fT~2l > satisfies lims^oo BD (Py\\P-y\ Be) = ^' which can be proven as follows. Fix 0. Then 

Pr(v) 



log 



Py(y) 

-- log 



1 



irNoB 



-E 



exp 



1 



\y-c H x 



log 



N B 
1 



exp 



log 



rE,=ilc,| 2 var[X 4 (i?)]+7V 0J B lyl 



N Q B 



\ogE 



exp 



Ef=iN 2 var[X 4 (B)]+iV B 



E?=ih\ 2 ™{MB)} + N B' 



log 



log£ 



exp 



1 



Y,ti\d\ 2 ™v[Xi(B)] + N B 

2 



\yf 



■^(|,| 2 -2 K { y c*X} + |c"X 



Using series expansion we then get 

My) 



log 



-- log | 



EiIi|ci| 2 var[Xi(S)]+iVoS' 



■logS 



l + o - 



N B 

1 \ 1 



B J N B 



2?ft{yc H X} - \c H X.\ 



Z?=i\*\ 2 ™lMB)] (!_ 
N B \B 







GO 


+ E 







^(25R{^X}-|c«X| 2 ) 



N Q B 



(20) 



(21) 



(22) 



(23) 



(24) 
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where (|24| | uses the Lebesgue convergence Theorem to exchange limit and expectation. Then 

Py(y) 



log 



where we have used (fTST l and 



YZi | Cl | 2 var[X 4 (B)] 



N B 



+ o 



D 



^( 2 ^c"X}-|c*X| 



'"1 



J K{yc H y,}dP MB )dPe = 



(25) 
(26) 

(27) 



Lemma 2: Suppose that for each value of £? we are given random variables U(B), V(B), and a random (vY-vector) 
random variable X(f?) that satisfy var[X(I?)] < P. Define 



Y 1 = cf X(B) + Zi 
Y 2 = c$X(B) + Z 2 

where Z x and Z 2 are independent, Z X ,Z 2 ~ jV(0, 2V -B)- Suppose that (U{B),V(B)) -> X(B) 
(U(B), V(B)) — > X(i3) — * F2 form Markov chains. If c is a constant vector then 

iim B/([/(B);Fi) 

B— >OC 



= lim 

B^oo 



lim 



var[cfX(B)] 
var[cfX(£)| 



Wo 

lim BJ(X(B);y 2 |l/(fl)) 



lim 

B^oo 



lim BI(U(B);Y 1 \V(B)) 



= lim 

B-^oc 



lim 

B^oo 



var[cfX(B)|[/(B)] 
Ao 

var[cfX(ff)|^(B)] 

var[cfX(B)|t/(B),y(B)] 
ATr, 



(28) 
(29) 

F x and 



(30) 



(31) 



(32) 
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If Cij = \cij \ e J where 6ij are iid random variables uniform on [0, 2ir] and |cy | constant then 

lim BI(U{B);Y x \0) 

B — >■ oo 

= Um Ejlx IchIWW)] 

B^oo N Q 

B^oo iVg 

lim BI(X(B);Y 2 \U(B),6) 

B—>oo 

= lim (34 ) 
lim BI(U(B);Y 1 \V(B),d) 

B— >oc 

B^oo iV 

_ Um Eti |c 1 ,| 2 var[X,(i3)|t7(g) 7 ^(i3)] 

B— ^oo iV 

Assuming all limits are defined. 

Proof: For ( I31I341 >. we use a conditional version of Lemma[T] For ( 130133b we write I(U (B) ; Y\) = I(X(B) ;Y\)— 
I(X(B);Yi\U(B)) (using the Markov chain property). For d32l35l > we write I(U(B);Y, \V(B)) = I{X(B);Y 1 \V(B))- 
I(X(B);Y 1 \U(B),V(B)). ■ 



IV. Deterministic Capacity of MIMO relay channels 




In this section we will find the low power deterministic capacity of the channels in Fig.Q]under certain conditions. 
Define 

W t = !>] (36) 

and notice that for deterministic capacity, node i must be able to decode Wi. Specifically, we have the following 
statement of Fano's inequality, proven similarly to Fano's inequality in [11]. 

Lemma 3 (Fano's inequality): Suppose that the source message W e {l...2 ni *}.Ifanode uses the deterministic 
sequence of codes X_ i [n] the following inequality holds 

l + Pr{x 4 [n]^X 4 [n}}nR > H (!>]!!:>]) (37) 
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Now define for i,j e {2, 3} 

Ri = lim^M (38) 
H(Wi\ Wi) 

R tl = lim V 11 3 > (39) 
R = lim Ml (40) 

n — >oo 77, 

We of course have R — R 23 + R 3 = R 32 + R 2 - 

The channel from node 1 to (2,3) is a MIMO broadcast channel in both networks. The MIMO broadcast channel 
was considered in [17] and [18]. However, in our case arbitrary dependency between the messages are allowed, 
and we therefore cannot directly use the results of [18]. However, we can prove the following outer bound, a 
generalization (to dependent messages) of Lemma 3.5 in [19] 

Proposition 1: The capacity region of the broadcast channel is contained in the convex closure of all (R, R 2l R3) 
that satisfy 

R2 < I{U 2 ;Y 2 ) (41) 
R3 < I(U 3 ;Y 3 ) (42) 
R = R 23 + R 3 < I(U 2 ;Y 2 \U 3 ) + I(U 3 ;Y 3 ) (43) 
R = R 3 2 + R 2 < I{U 3 ;Y 3 \U 2 )+I(U 3 ;Y 3 ) (44) 

for some joint distribution p(u 2 , u 3 )p(x\u 2 , u 3 ), where var[X] < Pi. 

The proof follows quite closely that of [19], so we will not provide it here. 

Theorem 1: The deterministic capacity of the relay channel in Fig. Q2a) in the low power regime in the syn- 
chronous case is given by maximizing 

R < (|c 3 ll| 2 + |C 3 1 2 | 2 )P 3 1 

+ (|c 2 ii| 2 + |c 2 i 2 | 2 ) cosV - 6)P 21 (45) 

R < (|c 3 ll| 2 + |c 3 l 2 | 2 )P 3 l 

+ (|C 3 11| 2 + |C31 2 | 2 )COS 2 (0)P 2 1 

2 



V^>i(|c 3 ii| 2 + |c 3 i 2 | 2 ) + \c 32 \^P~ 2 ) (46) 



with respect to P 2 i, P 3 i, Pn, and 9, subject to P 2 \ + P 3 \ + Pbi < Pi. Here a — arccos ■ m tne P na se 

fading case, the capacity is given by 

C = min {max{|c 3 n| 2 + |c 3 i 2 | 2 , 
|c 2 ii| 2 + |c 212 | 2 }P l7 

(|c3ii| 2 + |c3i 2 | 2 )Pi + |c3 2 | 2 P 2 } (47) 

Proof: The rate is bounded by 

R < I(Xi;Y 3 \U 2l X 2 ) + I(U 2] Y 2 \X 2 ) (48) 
R < I(X 1 ,X 2 ;Y 3 ) (49) 

The bound d49l is simply the MAC bound into the destination. In the following use the notation X[m] — 
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[X[m], X[m + 1], . . . , X[n]). The bound ( |48T > is then proven by the following chain of inequalities 

nR 

= H{W) = H(W 2 ) + H{W\W 2 ) (50) 
= H(W 2 \Y 2 [n]) + I(W 2 ;Y 2 [n]) 

+H{W\Y 3 [n],W 2 ) + I{W;YMW2) (51) 
< ne n + I(W 2 ]Y 2 [n])+I(W-,Y 3 [n]\W 2 ) (52) 

= ne n +J2 I (W 2 ;Y 2 [m] \Y 2 [m - 1]) 



+ ^2l(W;Y 3 [m]\W 2 ,Y 3 [m + l]) (53) 

m— 1 

n 

£ff(Y 2 [m]|y 2 [m-l]) 



-5^fl-(K a [m]|W2,l^[m-l]) 

m— 1 

n 

+ Y,H(Y 3 [m]\W 2 ,Y 3 [m + l}) 

m—1 

n 

- J2 H(Y 3 [m]\W,W 2 ,Y 3 [m+l}) (54) 

m—1 

n 

< ne n + ^H(Y 2 [m}\Y_ 2 \m-l]) 

m—1 

n 

-Y,H(Y 2 [m]\W 2 ,Y 2 [m-l}) 

m—1 

n 

+ Y,H(Y 3 [m]\W 2 ,Y 3 [m + l}) 

m—1 

n 

- H(Z 3 [m]\W,W 2 ,Y 3 [m + l]) (55) 

m—1 

n 

J2H(Y 2 [m)\Y 2 [m-l],X 2 [m]) 

m—1 

n 

- H(Y 2 [m]\W 2 ,Y 2 [m-l],X 2 [m]) 

m—1 

n 

+ J2 H ( Y 3H\W 2 ,Y 3 [m+l},X 2 [m}) 

m=l 

71 

- H(Z 3 [m]\W,W 2 ,Y 3 [m + l},X 2 [m}) (56) 

m—1 

n 

= ne n +Y I ( W 2> Y 2[rn]\Y 2 [m-l},X 2 [m]) 

m=l 

+ Y I(W;Y 3 [m]\W 2 ,Y 3 [m + l],X 2 [m}) (57) 

m—1 
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In d55l l we used that /i(ls[m]) = ft.(c 32 X 2 [m] + c|^Xi[m] + Z 3 [m]) > h(Zj,[m]) (in a conditional version), and 
in d56l l that -X^m] depends only on Y_ 2 [m — 1]. We now define [7 2 [m] = {W2,Y_ 2 [m — l],Y 3 [m + 1]), and use 
Csiszar's identity as in [19] (2.5-2.8) to obtain d48l . 

We will prove the theorem for the synchronous case. The proof in the phase-fading case is a simpler case that 
we will omit. Using lemma [2] we get the low power limit of (148149b as 

R < Um ^r[cgX 1 (B)\U 2 (B),X 2 (B)] 
var[c|iX 1 (B)|X 2 ( J B)] 



lim 

B—*co Ni 







_ Hm vax[c? 1 X 1 (B)\U 2 (B),X 2 (B)] 

B^oo N 

R < lim ^teM (59) 

~ B^oo N Q 

Let u be a unit vector in the direction of lims_ ) . 00 cov[Xi(5), X 2 (B)], and define 

^ = lim cpvtXp^ 
s^oo N Q ^var[X 2 (B)] 

X = lim (61) 
A = lim ™^{B)\MB)MB)] m 

B^oo TVr, 

B = X /3 2 P,uu H - A (63) 

Using Lemma [4] we then obtain the following outer bound to the low power rate 

R < c^Bcai + cgAc 2 i (64) 
R < cf 1 (A + B + /3 2 P 1 uu ff )c 31 + |c 32 | 2 P 2 



subject to 



+ 23?{/3c 32 cf 1 u}/p7p (65) 

trA + trB + 2 P l < P 1 (66) 
A,B y (67) 
P < 1 (68) 

on the other hand, if A, B, and (3 satisfy (1661168b . then d64l65l l constitute an upper bound on the rate. 

It is clear that d64ll65] > is maximized for A = P 2 i if" "la f° r some positive constant P 2 i. Now notice that if the 

|C21 || 

angle between c 2 i and c 3 i is acute (if not, we can just use — c 2 i), the bounds are maximized when the off-diagonal 
elements of B are maximized, i.e., if B has rank one. Thus, we can put B = P 3 i/Pvv ff , where v is a unit vector 
rotated an angle 8 from c 2 i in the real plane spanned by c 2 i,c 3 i, as any component outside this plane will not 
contribute to the bounds. Finally, the bounds are maximized for u = ]yf^jjy- It is now a straightforward calculation 
to get the bounds (|45| ) and d46l >. 

For the achievable rate we split the message W into two independent parts Wd and W r . The message Wd is 
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transmitted directly to the destination using power P31 and a rate 

Rd = (|C 3 11| 2 + |C312| 2 )P 3 1 

The message W r is transmitted through the relay using block Markov encoding with a rate 

R-r = min{(|c 2 ii| 2 + |c2i2| 2 )cos 2 (a-0)P 2 i, 



(69) 



|c 3 ll| 2 + |C31 2 | 2 )C0S 2 (6»)P21 



V Pl(l c 31l| 2 + |c 3 i 2 I 



(70) 



Adding up these rates achieves the upper bound. 
The proof of Theorem [T] uses the following Lemma 

Lemma 4: For any random variables X and Y with first and second order moments 

cov[X, Y]cov[X,Y] H 



cov[X|F] -< cov[X] 



var[rl 



Proof: We can assume that X and Y are zero mean. First, notice that 

cov[X|r] = E [XX H ] - E [E[X\Y]E[X\Y] H ] 
Second, the Cauchy-Schwartz inequality gives 

\E[v H XY]\ = \E[E[v H X\Y] Y]\ 



(71) 



(72) 



< 



E 



\Y\ 



E [v H E[X\Y]E[X\Y] H v] 



So, 



(73) 



(74) 



w H E [XY*] E [YX H ] v < v&r[Y]v H E [E[X\Y]E[X\Y] H ] v 

Which means cov [X, Y] cov [X, Y] H < v&r[Y}E [E[X\Y}E[X\Y} H ] . Inserting this gives <7T). ■ 
We now turn to the relay channel in Fig. |TJb). From the two relays to the destination we have a MAC channel. 
As opposed to the usual MAC channel, we have messages that can have arbitrary dependency. The usual MAC 
outer bound can be generalized as follows, with the difference being that X2 and X3 can no longer be assumed 
independent 

Proposition 2: The capacity region of of the multiple access channel with dependent messages is contained in 
the convex closure of all rates satisfying 



P23 < I(X 2 ;Y i \X 3 ) 
R32 < I(X 3 ;Y±\X 2 ) 
R < I{X^X S -Y 4 ) 



(75) 
(76) 
(77) 



for some joint distribution ^(^2,^3) that satisfies the power constraints. 

The proof follows the usual MAC proof in [11, Theorem 14.3.3], just replacing H^Wz) with -HXW2IW3) and 
H(W 3 ) with H{W 3 \W 2 ). 

Since the above bound, as the usual Gaussian MAC bound, is maximized by the Gaussian distribution, we get 
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directly the bound in the low power regime 

Corollary 1: The capacity region of the MAC channel in the low power regime in the synchronous case is 
contained in the convex closure of all all (R, R23, R32) that satisfies 

R23 < |c 42 | 2 P 2 (l-p 2 ) (78) 
R32 < |c 4 3| 2 -P 3 (l-p 2 ) (79) 



R < \C42\ 2 P2 + \C4 3 \ 2 P3 + 2P\ C42 \\C 43 \^/^ (80) 

for some p € [0, 1] in the synchronous case. 
In the phase-fading case the rates satisfy 

R 23 < M 2 P2 (81) 

R32 < |c 43 | 2 P3 (82) 

R < \c i2 \ 2 P2 + \c i3 \ 2 P 3 (83) 
Theorem 2: In the phase fading case, the deterministic capacity of the relay channel in Fig. Q] is given by 
transmitting a common message to the two relays in addition to two private messages. 

Proof: We will prove that upper bound for the broadcast part of the channel can be achieved with a 
common/private message transmission scheme. Since this is clearly also true for the MAC part, this will be sufficient 
to prove the Theorem. We will prove the theorem for the case when antenna 1 and antenna 2 of node 1 have separate 
power constraints, which we will denote P\ and P 2 . The result then clearly applies to the case when there is a sum 
power constraint, but it also applies to the case when the two antennas are actually on separate nodes. 

For the broadcast part of the channel, the achievable rate by common/private message transmission is given by 



R c = min{|c21l| 2 Plc+|c212| 2 -P2c,|c31l| 2 -Plc+|c312| 2 f , 2c} 

22 



R 2 = Rc + \C2U\ 2 P12 + \C212\ 2 P: 



R 3 = Rc + |c 3 ll| 2 Pl3 + |c31 2 | 2 P; 



23 

R = R C + |C211| 2 P12 + |C212| 2 ^22 + |C311| 2 P13 + |C312| 2 P ; 



23 



with the constraints 



Pic + P21 + P 3 1 < Pi 

P2c + P22+P 3 2 < P2 (84) 
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For the upper bound we apply Lemma [2] to the bounds of Proposition Q] 

R 2 < | C211 P lim ™[X nm -v a r[X nm U 2 (B)] 

B— >oo 



Define 



R 3 < |c 3 ii| 2 lim 

B— >oo 



2 



+ |C312, 

B- 



R < |c 311 | 2 lim 







vax[X 12 (B)] 


-var[X 12 {B)\U 2 (B)] 


n 

oo 


N 


var[X n {B)] - 


vav[X n (B)\U 3 (B)] 




N 


var[X 12 (B)} 


-var[X 12 (B)\U 3 (B)] 


n 

oo 


No 


var[X n (S)] - 


var[X n (B)\U 3 (B)} 



+ |c 2 n| 1™ 



B^oo N 

vai[X u (B)\U 3 {B)] 



B^oc N Q 

+ |c 3 i 2 | lim 



2 var[X 12 (B)]-vav[X 12 {B)\U 3 {B)] 



No 



+ |c 2i2 | 2 lim 



2 ls _ vav[X 12 (B)\U 3 (B)] 



R < \c 2 ixY lim 



var[Jfn(B)] -var[Xn(B)|^ 2 (B)] 



B^oo N 



+ |c 3 n| lim 



var 



[X n (B)\U 2 (B)} 



B^oc N Q 

var[X 12 (B)}-vav[X 12 (B)\U 2 (B)} 

+ |C212 ' J™ N 

2 var[X 12 
+ |C312 ' J™ N 

vax[X n {B)\U 3 (B)} 



Pi 2 = lim 

P 22 = lim 

P13 = lim 

P 23 = lim 

Pic : lim 



var[X 12 (B)\U 3 (B)] 

B—+QO N 

variXnjB^U^B)} 

B^oo No 

vaY[X 12 (B)\U 2 (B)} 
b""^o No 

var[Jfn(B)] -var[X u (B)|tf 3 (B)] 



lim 

B- 

P 2c = lim 



varfJfuCB)!^^)] 



var[X 12 (B)] -varLY 12 (5)1^(5)] 



-B^oo iV 

var[Xi 2 (B)|C/ 2 (B)] 
- lim — 

B^oc N 

Clearly Py > 0, so that we can think of them as powers. Notice that we cannot assume Pi C 
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With this we can write 



have the constraints 

P1C + P12+P13 < Pi (95) 

P 2c + P 22 +P 23 < P 2 (96) 

Pi c + Pi2 > (97) 

Pic + Pia > (98) 

P2C + P22 > (99) 

P2C + P23 > (100) 

R 3 < |c 2 n| 2 Pi c + |c 212 | 2 P 2c 

+ |c 2 n| 2 Pi 2 + |c 212 | 2 P 22 (101) 

R 4 < |c 3 ll| 2 Plc + |c 3 l 2 | 2 P 2c 

+ |C311| 2 P13 + |C312| 2 P 23 (102) 
R < |C 2 11| 2 P1 C +|C 212 | 2 P 2C +|C 211 | 2 P 12 

+ |c 2 i 2 | 2 P 22 + |c 3 n| 2 Pi 3 + |c 3 i 2 | 2 P 23 (103) 

R < |c31l| 2 Plc + |c31 2 | 2 P2c+|c21l| 2 Pl2 

+ |C 2 1 2 | 2 P 2 2 + |c 3 ll| 2 Pl3 + |C312| 2 P 23 (104) 

We will show that the upper bound can always be achieved by a common/private message solution. First consider 
the case {|c 2 n|, |c 2 i 2 |} < {| c 3ii|> IC312 1 }• The optimum solution has P i2 = P 22 = 0. Namely, putting P\ c — > 
Pic + Pi2 and P 2c — » P 2c + P 22 will not decrease any rate bounds, while the power bounds are still satisfied. 
Notice that we can now assume P\ c > 0, P 2c > 0. So, we end up with 

R 3 < |c 2 n| 2 Pi c + |c 212 | 2 P 2c (105) 

R 4 < |c 3 ll| 2 Plc + |c 3 l 2 | 2 P 2c 

+ |c 3 ll| 2 Pl3 + |c312| 2 P 2 3 (106) 
R < |C311| 2 P1 C + |C312| 2 P 2C 

+ |c 3 ll| 2 Pl3 + |c312| 2 P 2 3 (107) 
R < |c 2 ll| 2 Plc + |c 212 | 2 P 2c 

+ |c 3 ll| 2 Pl3 + |c312| 2 P 2 3 (108) 
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or 

R 3 < |C211| 2 P1 C +|C212| 2 P 2 C (109) 
R 4 < |c 2 ll| 2 Plc+|c21 2 | 2 P2c 

+ |C311| 2 P13 + |C312| 2 P 23 (HO) 
R < |C211| 2 P1 C +|C212| 2 P 2C 

+ |c 3 ll| 2 A3 + |c 3 12| 2 P 23 (HI) 

This can be achieved by transmitting a common message understood by both nodes, and a private message to node 
4. The symmetric case is similar. 

Next consider the case |caii| < |c3ii | , IC312 1 < |c2i2 1, with strict inequality in at least one of the inequalities. Then 
a solution with P\q, = P23 = is optimum, which can be seen by putting P\ c — > P\ c + P12 and P2 C — ► P 2c + P23. 
Again we can then assume P\ c > 0, P2 C > 0. Then 

R 3 < |C211| 2 P1 C +|C212| 2 P2 C +|C212| 2 P 2 2 (112) 

R 4 < |C311| 2 P1 C +|C 3 12| 2 P 2C +|C311| 2 P13 (113) 
R < |C 3 11| 2 P1 C +|C312| 2 P2C 

+ |C 3 11| 2 P13 + |C212| 2 P 2 2 (114) 
2c 

+ |C311| 2 P13 + |C212| 2 P 2 2 (115) 



R < |c21l| 2 Pl c +|c21 2 rP2, 



We will argue that we can always obtain an optimum solution with the right hand sides of (II 141 ) and ( II 15b equal. 

Assume the right hand side of d 1 14b is smaller than that of ( II 15b . We can decrease ( II 15b by putting P13 — » P13 — 5, 
Pic — > Pic + S. Either the bounds become equal, or we end up with P13 = 0, so 

R 3 < |C211| 2 P1 C +|C212| 2 P2C+|C212| 2 P22 (116) 

R 4 < |c 3 ll| 2 Plc+|c312| 2 P2c (117) 

R < |C311| 2 P1 C +|C 3 12| 2 P2C+|C212| 2 P 2 2 (118) 

R < |C211| 2 P1 C +|C212| 2 P2C+|C212| 2 P 2 2 (119) 

But this can be written as 

R 3 < |C311| 2 P1 C +|C312| 2 P2C+|C212| 2 P 2 2 (120) 

R 4 < |C311| 2 P1 C +|C312| 2 P2C (121) 

R < |C311| 2 P1 C +|C312| 2 P 2C +|C212| 2 P 2 2 (122) 

which can be achieved by a common message and a private message to node 3. 

On the other hand, suppose the right hand side of ( II 14b is larger than that of dl 151 ). Then we can decrease dl 141 ) 
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by by putting Pi 3 — > P22 — 5, Pic — ¥ Pic + S. If the two bounds don't become equal we end up with 

R 3 < |C211| 2 P1 C +|C21 2 | 2 P2 C (123) 

R 4 < |c 3 ll| 2 Pl c +|c 3 l 2 | 2 P2 C +|c31l| 2 Pl3 (124) 

R < |c 3 ll| 2 Pl c + |c312| 2 P2c + |c31l| 2 Pl3 (125) 

R < |C211| 2 P1 C +|C212| 2 P2C+|C311| 2 P13 (126) 

which, as above, can be achieved by common/private messaging. ■ 
Theorem 3: Consider the relay channel in Fig. |TJb) for the synchronous case. Assume that 

min{||c2i|| 2 ,||c 3 i|| 2 } < |cf lC3 i|. (127) 

The deterministic capacity is then given by transmitting a common message to the relays and a private message to 
one of the relays. 

Proof: We will prove that the upper bound for the broadcast cut set can be achieved by a common/private 
message solution. Without loss of generality we can consider the case ||c 2 i|| > ||c 31 ||. According to Lemma[T]and 
|2] we have 

R 2 < Um BvarlcgXtB)] 

B^oo No 

Urn (128) 



R s < lim 



Pvar[c£X(P)] 



B^oo N 

Pvarlc 
lim 

B^oo Ni 



lim (129) 



and 



R < lim B ™KMB)\U 3 (B)} 



B^oc Ni 







R < lim 



,. Pvar[c^X(P)l 
hm — — — - 

B^oo N 

lim ^m*mm 

S^oo N 

Bvar[cgX(B)\U 2 (B)} 



B^oo Nt 

As in the proof of Theorem [2] we can upper bound this by 



B^co No 

Pvar[c£X(P)l 
+ hm — — 

B^oo N 

lim B^ [c ^ { B)\U 2m (131) 
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R 2 


< 


c 21 


(X 


-A) 


C21 




R 3 


< 


c 31 


(X 


B) 


C 3 1 




R 


< 


c 31 


(X 


B) 


C31 " 


- cfiBcsi 


R 


< 


c 21 


(X 


-A) 


C21 - 


1- c^Ac 3 i 



(132) 
with the conditions 

trX < P (133) 
X y A,B (134) 
A,B y (135) 

Notice that the condition ||c2i|| 2 > c|jC3i > 1 1 C3 1 1 1 2 ensures that c^v > c^v for any vector v. Consequently 
C2^Ac 2 i > cf^Ac 31 , and we can put A = without decreasing any bounds. The bounds then are 

(136) 
(137) 
(138) 
(139) 

Here the right hand side of ( 11381 ) is clearly larger than the right hand side of ( 11391 ), so we can rewrite as 

R 2 < c£Cc 31 +c£Bc 2 i (140) 
R3 < cgCc 3 i (141) 
X = C + B (142) 

It is clear that this is optimized for B = a 2 C2iC 2 ^ and C = a^caicf^, and that this can be achieve by transmitting 
a private message in the direction of C21 and a common message in the direction of C31. ■ 
On the other hand, it is shown in the Appendix that Theorem [3] is not necessarily true if the condition j 127b is not 
satisfied. 



R 2 


< 


cgXc 2i 




R 3 


< 


c 3 H i(X- 


B)C31 


R 


< 


c 3 H i(X- 


B)c 31 +cgBc 21 


R 


< 


C^XC21 





V. Concluding remarks 

In this paper the deterministic capacity has been found for two MIMO relay networks in the low power regime. 
The methodology certainly can be extended to other networks. For example, it is not difficult to see that the results 
for the networks in Figure Q] can be generalized to the case when nodes have more antennas. Also, some links 
and extra relays can be carefully added. The paper [7] shows how deterministic capacity can be generalized to a 
two node cooperative MAC channel. That paper also shows that the functions of messages are not always simply 
sub-messages (already [8] shows that more general function of messages are needed). 

On the other hand, it is very difficult to find the deterministic capacity of larger networks in general with the 
present methodology. For example, if a link between the relays in Figure Q2b) or between source and destination 
is added, or if more relays are added, there is not straightforward way of generalizing the results presented here. 

There are two issues that make generalization difficult. First, it is very difficult to find single letter bounds. 
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For example, there is no direct way to generalize Nair and El Gamal's bound [19]or Marton's bound [20] for the 
broadcast channel to more than two nodes. Non-single letter bounds for general networks can easily be found by 
using Fano's inequality, Ri < I(Wi;Yi) and Rij < I(Wi; Yi\Wj). But there seems to be no systematic way of 
generating single letter bounds from these for larger networks. 

Secondly, even when single letter bounds exist, they may not be tight, as we have seen for the network[Hb) in the 
synchronous case. This could of course just be because Nair and El Gamal's bound is not the best possible single 
letter bound. However, this appears to be a more fundamental issue. Single letter bounds essentially show that iid 
(independent, identically distributed) input is optimum. Instead take non-single letter bounds such as Ri < I(Wi\ Y) 
and Rij < KW^Y^Wj) and assume that iid input is optimum. Then the counter example in the Appendix still 
works. This indicates that either there is better transmission scheme than common/private messages, or that Fano- 
type bounds are not tight. 

References 

[1] J. N. Laneman, D. N. C. Tse, and G. W. Wornell, "Cooperative diversity in wireless networks, efficient protocols and outage behavior," 

IEEE Transactions on Information Theory, vol. 50, no. 12, pp. 3062 - 3080, December 2004. 
[2] A. H0st-Madsen and J. Zhang, "Capacity bounds and power allocation for wireless relay channels," IEEE Transactions on Information 

Theory, vol. 51, no. 6, pp. 2020 - 2040, June 2005. 
[3] G. Kramer, M. Gastpar, and P. Gupta, "Cooperative Strategies and Capacity Theorems for Relay Networks," IEEE Transactions on 

Information Theory, vol. 51, no. 9, pp. 3037-3063, 2005. 
[4] T. Cover and A. E. Gamal, "Capacity theorems for the relay channel," IEEE Transactions on Information Theory, vol. 25, no. 5, pp. 

572-584, September 1979. 

[5] B. Wang, J. Zhang, and A. H0st-Madsen, "On the ergodic capacity of MIMO relay channel," IEEE Transactions on Information Theory, 

vol. 51, no. 1, pp. 29-43, January 2005. 
[6] C. Lo, S. Vishwanath, and R. Heath, "Rate bounds for mimo relay channels using precoding," in Proceedings of Global Telecommunications 

Conference: GLOBECOM '05, November 2005. 
[7] G. Yue, X. Wang, Z. Yang, and A. H0st-Madsen, "Coding schemes for user cooperation in low-power regimes," IEEE Transactions on 

Signal Processing, vol. 56, pp. 2035-2049, May 2008. 
[8] P. Razaghi and W. Yu, "Parity forwarding for multiple-relay networks," IEEE Transactions on Information Theory, vol. 55, no. 1, pp. 

158-173, Jan. 2009. 

[9] B. Nazer and M. Gastpar, "Computation over multiple-access channels," IEEE Transactions on Information Theory, vol. 53, no. 10, pp. 
3498-3516, October 2007. 

[10] R. Ahlswede, N. Cai, S. Li, and R. Yeung, "Network information flow," IEEE Transactions on Information Theory, vol. 46, no. 4, pp. 

1204-1216, July 2000. 
[11] T. Cover and J. Thomas, Information Theory. John Wiley, 1991. 

[12] A. H0st-Madsen, "On the capacity of cooperative diversity," IEEE Transactions on Information Theory, vol. 52, no. 4, pp. 1522 - 1544, 
April 2006. 

[13] S. Verdu, "Spectral efficiency in the wideband regime," IEEE Transactions on Information Theory, vol. 48, no. 6, pp. 1319-1343, June 
2002. 

[14] , "On channel capacity per unit cost," IEEE Transactions on Information Theory, vol. 36, no. 5, pp. 1019-1030, Sep. 1990. 

[15] Y. Yao, X. Cai, and G. Giannakis, "On energy efficiency and optimum resource allocation of relay transmissions in the low-power regime," 

IEEE Transactions on Wireless Communications, vol. 4, no. 6, pp. 2917-2927, 2005. 
[16] D. Guo, S. Shamai, and S. Verdu, "Mutual information and minimum mean-square error in Gaussian channels," IEEE Transactions on 

Information Theory, vol. 51, no. 4, pp. 1261-1282, Apr. 2005. 
[17] G. Caire and S. Shamai, "On the achievable throughput of a multi-antenna Gaussian broadcast channel," IEEE Transactions on Information 

Theory, vol. 49, no. 7, pp. 1691-1706, July 2003. 
[18] H. Weingarten, Y. Steinberg, and S. Shamai, "The capacity region of the gaussian multiple input multiple output broadcast channel," IEEE 

Transactions on Information Theory, submitted. 
[19] C. Nair and A. E. Gamal, "An outer bound to the capacity region of the broadcast channel," IEEE Transactions on Information Theory, 

vol. 53, no. 1, pp. 350-355, Jan. 2007. 
[20] K. Marton, "A coding theorem for the discrete memoryless broadcast channel," IEEE Transactions on Information Theory, vol. 25, no. 3, 

pp. 306-311, May 1979. 



April 1, 2009 



DRAFT 



20 



Appendix 

In this appendix we will show that the upper bound of Theorem Q] is not necessarily achievable with com- 
mon/private message transmission in the synchronous case. Specifically we will prove that the bound ( 11321 i is not 
achievable by common/private message transmission. Strictly speaking it does not prove that Theorem Q] is not 
achievable, as it is not proven that any set of positive definite matrices (X, A, B) (with X y A, B) is a valid set 
of covariance matrices. However, it indicates that the proof technique does not work in general for the synchronous 
case. 



We put ||c 2 i| 



l c 3i|| 2 = 1 an d ^( c 2i,C3i) = a = 0.4. We consider the real subspace spanned by 021,031, 



and in this define an orthonormal basis by {c 2 i, c^}. Then 



c 3 i 



cos a 
sin a 

0.9211 
0.3894 



We now define 



cos 0.208 




" 0.9784 " 


sin 0.208 




0.2065 



X 


B = 


vv H 




B = 


C2icg 




A = 


0.05c 31 cg 




X = 


B + (X - B) 


X 


A = 


vv ff + c 2i cg 



c 21 cg 



0.05c 3 icg 
1.9149 0.1841 
0.1841 0.03506 

The eigenvalues of X— A are (0.01720, 1.9328), so X — A is positive definite. We now have 

R 2 = c£(X-A)c2i 

= cos 2 (0.208) + 1 - 0.05 cos 2 a = 1.9149 

R 3 - cf 1 (X-B)c 3 i 

= cos 2 (a- 0.208) = 0.9636 

R a = cf 1 (X-B)c 3 i+cgBc 2 i 

= 0.9636+ 1 = 1.9636 

R 6 = eg (X - A)c 21 + cgAc 31 

= 1.9149 + 0.05 = 1.9649 



(143) 
(144) 

(145) 

(146) 
(147) 
(148) 
(149) 
(150) 

(151) 



(152) 



Consider the achievable rate by a common/private messaging scheme in the Gaussian channel. We transmit the 
common message along a unit vector u and beamform the private messages to their respective destinations. This 
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scheme achieves the following rates 

Ro < min{c^ L uuc2i, c^uuc3i}Po (153) 

R 2 < ||c 2 i|| 2 P 2 + i?o (154) 

R 3 < ||c 3 i|| 2 P 3 + i?o (155) 

R < ||c2i|| 2 P 2 + ||c3i|| 2 P 3 + i?o (156) 
subject to the constraint P0+P2+P3 < P. Put 

Cq = max min{c2^uuc2i, cl^uucsi} (157) 

l|u|| = l 

In this case it's easy to see that 

c 2 = cos 2 (a/2) = 0.9605 (158) 
Now consider the problem of given a rate triple (R2, R3, R) minimizing the total power P. We have to solve 



R R 2 R 3 



min \ — + ITlu + ¥^12 r (159) 

I c ||c 2 || 2 ||c 3 || 2 J 

subject to 

R2 + R0 > R2 (160) 

R3 + R0 > R 3 (161) 

R2 + R3 + R0 > R (162) 

It's easy to see that the optimum solution is 

R 2 + R3 - R R - R3 , R - R 2 nftV . 

F = h ~n — ii2~ + ~n — ii2~ ^ 163) 

co ||c 2 || 2 ||c 3 || 2 

Inserting (R 2 , R 2 , R) = (1.9149, 0.9636, 1.9636) from ( fT52l we get 

^ R? ~\~ R^ — R „ „ „ „ 

p = — — ^ — + R-R2 + R-R3 

Co 

= 2.0011 >trX = 2 (164) 
which shows that the solution ( 11521 i is not achievable by common/private message transmission. 
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